Psychometric evaluation of the Symptoms of Infection with Coronavirus-19 (SIC): results from a cross-sectional study and a phase 3 clinical trial.

BACKGROUND: The Symptoms of Infection with Coronavirus-19 (SIC) is a 30-item patient-reported outcome (PRO) measure scored by body system composites to assess signs/symptoms of coronavirus disease 2019 (COVID-19). In addition to cross-sectional and longitudinal psychometric evaluations, qualitative exit interviews were conducted to support the content validity of the SIC. METHODS: In a cross-sectional study, adults diagnosed with COVID-19 in the United States completed the web-based SIC and additional PRO measures. A subset was invited to participate in phone-based exit interviews. Longitudinal psychometric properties were assessed in ENSEMBLE2, a multinational, randomized, double-blind, placebo-controlled, phase 3 trial of the Ad26.COV2.S COVID-19 vaccine. Psychometric properties evaluated included structure, scoring, reliability, construct validity, discriminating ability, responsiveness, and meaningful change thresholds of SIC items and composite scores. RESULTS: In the cross-sectional study, 152 participants completed the SIC (mean age, 51.0 ± 18.6 years) and 20 completed follow-up interviews. Fatigue (77.6%), feeling unwell (65.8%), and cough (60.5%) were symptoms most frequently reported. SIC inter-item correlations were all positive and mostly moderate (r ≥ 0.3) and statistically significant. SIC items and Patient-Reported Outcomes Measurement Information System-29 (PROMIS-29) scores correlated as hypothesized (all r ≥ 0.32). Internal consistency reliabilities of all SIC composite scores were satisfactory (Cronbach's alpha, 0.69-0.91). SIC composite scores correlated moderately (r = 0.30-0.49) to strongly (r ≥ 0.50) with PROMIS-29 scores and Patient Global Impression of Severity (PGIS) ratings (all P < 0.01). A variety of signs/symptoms were cited in exit interviews, and participants considered the SIC straightforward, comprehensive, and easy to use. From ENSEMBLE2, 183 participants with laboratory-confirmed moderate to severe/critical COVID-19 were included (51.5 ± 14.8 years). Strong test-retest reliabilities were observed for most SIC composite scores (intraclass correlations ≥ 0.60). Statistically significant differences across PGIS severity levels were found for all but 1 composite score, supporting known-groups validity. All SIC composite scores demonstrated responsiveness based on changes in PGIS. CONCLUSIONS: The psychometric evaluations provided strong evidence for the reliability and validity of the SIC for measuring COVID-19 symptoms, supporting its use in vaccine and treatment trials. In exit interviews, participants described a broad range of signs/symptoms consistent with previous research, further supporting the content validity and format of the SIC.

Coronavirus disease 2019 (COVID-19) is a serious disease that continues to evolve globally. Researchers developed the Symptoms of Infection with Coronavirus-19 (SIC), a 30-item questionnaire designed for patients to report signs and symptoms of COVID-19. In this study, the researchers formally analyzed how well the SIC measures the patient experience with COVID-19, using survey and clinical trial data as well as telephone interviews. Adults with COVID-19 and at least 2 bothersome symptoms completed the web-based survey, and some of these individuals also participated in in-depth interviews. Participants in a clinical trial for a COVID-19 vaccine also completed the SIC measure. The SIC was compared with other commonly used questionnaires that evaluate patient experience. The most commonly reported symptoms of COVID-19 were fatigue, feeling unwell, cough, weakness, and headache. The items for individual symptoms (e.g., "cough") and combined scores for body systems (e.g., "respiratory system") performed well in statistical analyses. Participants found the SIC to be straightforward, comprehensive, and easy to use. The SIC may prove useful in the future for vaccine and treatment trials for COVID-19.

Development of a novel patient-reported outcome measure to assess signs and symptoms of COVID-19.

BACKGROUND: Given the urgent need for vaccines and treatments for coronavirus disease 2019 (COVID-19), the Symptoms of Infection with Coronavirus-19 (SIC), a comprehensive, patient-reported outcome (PRO) measure of signs and symptoms associated with COVID-19, was developed in full alignment with current US regulatory guidance to support evaluations of vaccines and treatments in development. METHODS: An initial version of the SIC was developed to address concepts identified through a targeted literature review and consultation with experts in infectious diseases and clinicians routinely managing COVID-19 in a hospital setting. A qualitative study was conducted in sites in the United States among 31 participants aged ≥ 18 years who were English-speaking and willing and able to provide informed consent and a self-reported history by telephone or online method. The measure was refined based on additional feedback from the clinicians and three iterative rounds of combined concept elicitation and cognitive debriefing interviews conducted with patients, caregivers, and healthy volunteers. RESULTS: Among 39 scientific articles identified in the literature review, 35 COVID-19 signs and symptoms were reported and confirmed during interviews with clinicians, patients, and caregivers. Patients and healthy participants suggested changes for refining the draft SIC to ensure consistent interpretation and endorsed both the 24-h recall period and use of an 11-point numeric rating scale (NRS) for capturing change in symptom severity. The final version of the SIC captures the daily presence or absence of 30 symptoms and a rating of severity for 25 of the 30 symptoms using an NRS for those symptoms reported as present. CONCLUSIONS: The SIC comprehensively addresses observations described in the literature, by clinicians, and by patients, and captures patients' experiences with COVID-19 in a manner that minimizes complexity and facilitates completion for both patients and healthy volunteers. This measure is thus appropriate for use in clinical trials of both therapeutics and vaccines for COVID-19.

Final Analysis of Efficacy and Safety of Single-Dose Ad26.COV2.S.

BACKGROUND: The Ad26.COV2.S vaccine was highly effective against severe-critical coronavirus disease 2019 (Covid-19), hospitalization, and death in the primary phase 3 efficacy analysis. METHODS: We conducted the final analysis in the double-blind phase of our multinational, randomized, placebo-controlled trial, in which adults were assigned in a 1:1 ratio to receive single-dose Ad26.COV2.S (5×1010 viral particles) or placebo. The primary end points were vaccine efficacy against moderate to severe-critical Covid-19 with onset at least 14 days after administration and at least 28 days after administration in the per-protocol population. Safety and key secondary and exploratory end points were also assessed. RESULTS: Median follow-up in this analysis was 4 months; 8940 participants had at least 6 months of follow-up. In the per-protocol population (39,185 participants), vaccine efficacy against moderate to severe-critical Covid-19 at least 14 days after administration was 56.3% (95% confidence interval [CI], 51.3 to 60.8; 484 cases in the vaccine group vs. 1067 in the placebo group); at least 28 days after administration, vaccine efficacy was 52.9% (95% CI, 47.1 to 58.1; 433 cases in the vaccine group vs. 883 in the placebo group). Efficacy in the United States, primarily against the reference strain (B.1.D614G) and the B.1.1.7 (alpha) variant, was 69.7% (95% CI, 60.7 to 76.9); efficacy was reduced elsewhere against the P.1 (gamma), C.37 (lambda), and B.1.621 (mu) variants. Efficacy was 74.6% (95% CI, 64.7 to 82.1) against severe-critical Covid-19 (with only 4 severe-critical cases caused by the B.1.617.2 [delta] variant), 75.6% (95% CI, 54.3 to 88.0) against Covid-19 leading to medical intervention (including hospitalization), and 82.8% (95% CI, 40.5 to 96.8) against Covid-19-related death, with protection lasting 6 months or longer. Efficacy against any severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection was 41.7% (95% CI, 36.3 to 46.7). Ad26.COV2.S was associated with mainly mild-to-moderate adverse events, and no new safety concerns were identified. CONCLUSIONS: A single dose of Ad26.COV2.S provided 52.9% protection against moderate to severe-critical Covid-19. Protection varied according to variant; higher protection was observed against severe Covid-19, medical intervention, and death than against other end points and lasted for 6 months or longer. (Funded by Janssen Research and Development and others; ENSEMBLE ClinicalTrials.gov number, NCT04505722.).

Safety and Efficacy of Single-Dose Ad26.COV2.S Vaccine against Covid-19.

BACKGROUND: The Ad26.COV2.S vaccine is a recombinant, replication-incompetent human adenovirus type 26 vector encoding full-length severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) spike protein in a prefusion-stabilized conformation. METHODS: In an international, randomized, double-blind, placebo-controlled, phase 3 trial, we randomly assigned adult participants in a 1:1 ratio to receive a single dose of Ad26.COV2.S (5×1010 viral particles) or placebo. The primary end points were vaccine efficacy against moderate to severe-critical coronavirus disease 2019 (Covid-19) with an onset at least 14 days and at least 28 days after administration among participants in the per-protocol population who had tested negative for SARS-CoV-2. Safety was also assessed. RESULTS: The per-protocol population included 19,630 SARS-CoV-2-negative participants who received Ad26.COV2.S and 19,691 who received placebo. Ad26.COV2.S protected against moderate to severe-critical Covid-19 with onset at least 14 days after administration (116 cases in the vaccine group vs. 348 in the placebo group; efficacy, 66.9%; adjusted 95% confidence interval [CI], 59.0 to 73.4) and at least 28 days after administration (66 vs. 193 cases; efficacy, 66.1%; adjusted 95% CI, 55.0 to 74.8). Vaccine efficacy was higher against severe-critical Covid-19 (76.7% [adjusted 95% CI, 54.6 to 89.1] for onset at ≥14 days and 85.4% [adjusted 95% CI, 54.2 to 96.9] for onset at ≥28 days). Despite 86 of 91 cases (94.5%) in South Africa with sequenced virus having the 20H/501Y.V2 variant, vaccine efficacy was 52.0% and 64.0% against moderate to severe-critical Covid-19 with onset at least 14 days and at least 28 days after administration, respectively, and efficacy against severe-critical Covid-19 was 73.1% and 81.7%, respectively. Reactogenicity was higher with Ad26.COV2.S than with placebo but was generally mild to moderate and transient. The incidence of serious adverse events was balanced between the two groups. Three deaths occurred in the vaccine group (none were Covid-19-related), and 16 in the placebo group (5 were Covid-19-related). CONCLUSIONS: A single dose of Ad26.COV2.S protected against symptomatic Covid-19 and asymptomatic SARS-CoV-2 infection and was effective against severe-critical disease, including hospitalization and death. Safety appeared to be similar to that in other phase 3 trials of Covid-19 vaccines. (Funded by Janssen Research and Development and others; ENSEMBLE ClinicalTrials.gov number, NCT04505722.).